Statistical descriptions of nonlinear systems at the onset of chaos 
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Abstract 

Ensemble of initial conditions for nonlinear maps can be described in terms of entropy. This en- 
semble entropy shows an asymptotic linear growth with rate K. The rate K matches the logarithm 
of the corresponding asymptotic sensitivity to initial conditions A. The statistical formalism and 
the equality K = \ can be extended to weakly chaotic systems by suitable and corresponding gen- 
eralizations of the logarithm and of the entropy. Using the logistic map as a test case we consider 
a wide class of deformed statistical description which includes Tsallis, Abe and Kaniadakis pro- 
posals. The physical criterion of finite-entropy growth K strongly restricts the suitable entropies. 
We study how large is the region in parameter space where the generalized description is useful. 
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I. INTRODUCTION 



Sensitivity to initial conditions in chaotic systems has an exponential asymptotic regime 
in fully-chaotic regions and a power-law regime in transition regions. A description in terms 
of generalized exponentials leading to the definition of generalized Lyapunov exponents 
gives an unified framework for both regimes . For instance, if Tsallis' generalization is 
used: the sensitivity ^ = \im/^x(^Q)^Q Ax(t) / Ax{0) grows asymptotically as the generalized 
exponential exp(At), where exp(x) = expg(x) = [l + {l — q)xY^^^~'^^; the exponential behavior 
for the chaotic regime is recovered for q ^ 1: lim^^i expq(Agt) = exp(At). A large class of 
generalized exponentials shows similar behavior 2]- 

The statistical definition of entropy production rate, where an ensemble of initial condi- 
tions confined to a small region is let evolve and the entropy is a functional of the occupation 
numbers of an appropriate partition, shows close analogy to the production rate of thermal 
entropy and appears to coincide with the Kolmogorov-Sinai entropy in chaotic regimes P|. 

This rate of loss of information can be also suitably generalized to include both full- 
chaotic and edge-of-chaos cases. At the edge of chaos the statistical description is recovered 
with the generalized entropic form proposed by Tsallis 4] Sq = {1 — ^^=iP'i) Ko. ~ !)> which 
grows linearly for a specific value of the entropic parameter q characteristic of the system: 
lim^^oo limL_,o 'S'g(t)/t = Kq, where Sq reduces to — XliliP* I'^SP* limit q ^ 1, pi 

being the fraction of the ensemble found in the i-th cell of linear size L. As a matter 
of fact a large class of entropies, which includes Tsallis'one, reproduces this asymptotic 
linear behavior . The asymptotic power law behavior (exponent) that characterizes the 
entropy growth is the same that describes the asymptotic power-law sensitivity to initial 
conditions 0,0,1^. 

Finally, it has been also conjectured that the relationship between the asymptotic entropy- 
production rate K and the Lyapunov exponent A for chaotic systems (the Pesin-like iden- 
tity |^|: K = X) can be extended to systems at the edge of chaos Kg = Xg l|. 

There exist numerical evidences supporting this framework with the entropic form 5*0 for 

n Q 

the logistic jl| and generalized logistic- like maps [7|]. The linear behavior of the general- 
ized entropy for specific choices of q has been observed for two families of one-dimensional 
dissipative maps j8|. 

Evidence exists also for a more generalized coherent statistical framework, which includes 
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Tsallis' proposal The generalized _entro pic_ form is — Pilog(pi), where log 



indicates the following two-parameter family |9|, [lOl, |ll| 



I2L Il3l | of logarithms 



a + p 

where a {(3) characterizes the large (small) argument asymptotic behavior; in particular, 
exp(Ai(:) = log (At) ~ (At)^/" for large t. The requirements that the logarithm be 
an increasing function, therefore invertible, with negative concavity (the related entropy is 
stable), and that the exponential be normalizable for negative arguments select < a < 1 
and < /3 < 1 Q|; solutions with negative a and (3 are duplicate, since the family 
possesses the symmetry a <-> — /3. 

Renormalization-group methods have been used Q, 0| to demonstrate that the asymp- 
totic behavior of the sensitivity to initial conditions in the logistic and generalized logistic 
maps is bounded by a specific power-law whose exponent could be determined analytically 
for initial conditions on the attractor. For evolution on the attractor the connection between 
entro py and sensitivity has been studied analytically and numerically for Tsallis' entropic 
form |l8l |. 

Sensitivity and entropy production have been studied in one- dimensional dissipative maps 
using ensemble- averaged initial conditions chosen uniformly over the interval embedding 
the attractor the statistical picture, i.e., the relation between sensitivity and entropy 
exponents and the generalized Pesin-like identity, has been confirmed. Indeed the ensemble- 
averaged initial conditions appear more relevant for the connection between ergodicity and 
chaos and for practical experimental settings. 

The main objective of the present work is to review the general validity of the above- 
described picture, including the generalized Pesin-like identity, and the physical criterion of 
finite-entropy production per unit time (linear growth), which strongly selects appropriate 
entropies and fixes their parameters. In addition we specifically study how large is the 
transition region where the generalized formalism is useful, before the usual exponential 
regime sets in. 
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II. STATISTICAL DESCRIPTION 



From our investigation on the entire class of logarithms in Eq. we review results for 
the following one-parameter cases: 

(1) Tsallis' seminal proposal [P]: a = 1 — q and /? = 0; 

(2) the 7 logarithm [28]: a = 2(3 = 2r, 

(3) the Abe logarithm: i3 = a/{l + a) = l — qa, named after the entropy introduced by 
Abe |20j], which possesses the symmetry qa ^/qa', 

(4) the Kaniadakis logarithm: a = j3 = n, which shares the same symmetry group of 
the relativistic momentum transformation and has applications in cosmic-ray and plasma 
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physics 

Our laboratory is the logistic map Xj+i = 1 — fixf, at and near the infinite bifurcation 
point yUoo = 1.401155189. If the sensitivity follows a deformed exponential ^(t) = exp(At), 
analogously to the chaotic regime when ^{t) ~ exp(At), the corresponding deformed loga- 
rithm of ^ should yield a straight line log(^(t)) = log(exp(At)) = At. 

Starting from an initial condition xq, the sensitivity has been obtained, ^{t) = 
(2/i)* fl*"^ for 1 < t < 80; the generalized logarithm log(^) has been averaged over 
a sample of 4 x 10^ random initial conditions — 1 < Xq < 1. The averaging over initial 
conditions, (■■■), is appropriate for a comparison with the entropy production. 

For each of the generalized logarithms, (log(^(t))) has been fitted to a quadratic function 
for 1 < t < 80 and a has been chosen such that the coefficient of the quadratic term be 
zero; in fact log(^) linear in t means that the sensitivity ^ behaves as exp(At): we label this 
value al^^^. 

In fact, the exponent obtained with this procedure has been denoted q^^^^ in the case of 
Tsallis' entropy 19] and it is different from gsens obtained by choosing the initial condition 
Xq (fixed point of the map) [iS^ . 

The values of a^cns corresponding to the four different choices of the logarithm are (1) 
0.644, (2) 0.656, (3) 0.657, and (4) 0.653 with a statistical errors of 0.002, calculated by 
repeating the fitting procedure for sub-samples, and a systematic error of 0.004, estimated 
by fitting over different ranges of t. The exponent of Tsallis' formulation agj^s — 0.644±0.002 
is consistent with the value of Ref. ggj^g = 1 — a'^cns ~ 0.36. The values of a'^cns obtained 
using the four different formulations are within ±1%: the common asymptotic behavior 
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(deviations at the 1% level are due to the inclusion in the global fitting of small values of $,) 
is al^^, = 0.650 ± 0.005. 

Figure HI shows the straight-line behavior of log(^) for a = Qscns- ^^e corresponding slopes 
A (generalized Lyapunov exponents) are (1) 0.271 ±0.003, (2) 0.198±0.002, (3) 0.185±0.002, 
and (4) 0.148 ±0.001 from top to bottom; an additional systematic error of about 0.003 has 
been estimated by different choices of the range of t. While the values of a are consistent 
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FIG. 1: Generalized logarithms log(.^), see Eq. (pQ), of the sensitivity to initial conditions averaged 
over 4 x 10'' uniformly distributed initial conditions as function of time. From top to bottom: 
Tsallis', 7, Abe's, and Kaniadakis' logarithms. The linear rising behavior has been obtained with 
the asymptotic power a^^^^. 

The entropy has been calculated by dividing the interval (—1, 1) in W = 10^ equal-size 
boxes, putting at the initial time = 10^ copies of the system with a uniform random 
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distribution within one box, and then letting the systems evolve according to the map. At 
each time Pi{t) = ni{t)/N, where ni{t) is the number of systems found in the i-th box at 
time t, the entropy of the ensemble is 

where (■ ■ ■) is an average over 2 x 10^ experiments, each one starting from one box randomly 
chosen among the W boxes. The choice of the entropic form Q is fundamental for a coherent 
statistical picture: the usual constrained variation of the entropy in Eq. (j21) respect to pi 
yields as distribution the deformed exponential exp(x) whose inverse is indeed the logarithm 
appearmg m Eq. dU H- 

Analogously to the strong chaotic case, where an exponential sensitivity {a = (3 = 0) is 
associated to a linear rising Shannon entropy, which is defined in terms of the usual logarithm 
{a = (3 = 0), and consistently with the conjecture in Ref. ^, the same values a and (3 of 
the sensitivity are used in Eq. 0: Fig. |2l shows that this choice leads to entropies that grow 
also linearly. This linear behavior is lost for values of the exponent a different from a^^^^, 
confirming for the whole class © what was already known for the g- logarithm ^, 19|. 

The resulting rate of growth of several entropies Kjs = Spii^/t are (1) 0.267 ± 0.003, (2) 
0.197. ± 0.002, (3) 0.186 ± 0.002, and (4) 0.152 ± 0.002, where the statistical errors have 
been again estimated by sub-sampling the experiments. While this rate K depends on the 
choice of the entropy, the generalized Pesin-like identity holds for each given deformation: 

Kp = Xp . (3) 



III. WIDTH OF THE TRANSITION REGION 



Since we follow the system for a finite amount of time and the sensitivity and entropy 
at each time step has a finite error, we expect that the statistical description of the system 
using a generalized formulation is practically useful not only at the precise onset of chaos, 
but also for values of /i slightly larger (fully chaotic region) or smaller (periodic region). 
To estimate the width of the interval of /i, we have repeated the two previous experiments 
(sensitivity and entropy) with nine values of /x: four above and four below the onset of chaos. 

In Fig. El we report our result for the sensitivity in the case of Tsallis' formulation: anal- 
ogous results have been found for the other formulations. These curves should be compared 
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FIG. 2: Entropy as function of time, averaged over 2 x 10^ experiments, each one with an ensemble 
of 10^ points over a grid of 10^ boxes. The entropies belong to the class of Eq. and are defined 
with exactly the same exponents a and /5 used for the sensitivities; as in Fig. ^ the curves show 
Tsallis', 7, Abe's, and Kaniadakis' entropies from top to bottom. Straight lines are guides to the 
eyes. 

with the top curve in Fig. It appears that for t < 30 all systems with 1.400 ~ /i ~ 1.402 
can be described by the generalized formalism. This estimate is confirmed by the corre- 
sponding curves for the entropy in Fig. |3] 

For longer times the window shrinks: at t = 80 already values of fi different by 0.03% 
from the critical values deviate from the power-law behavior (see Fig. IHI). 
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FIG. 3: Generalized logarithms log(.^), see Eq. of the sensitivity to initial conditions averaged 
over lO"^ uniformly distributed initial conditions as function of time in the case of Tsallis' formu- 
lation (/3 = 0) for nine values of fi. The central curve = 1.401155189) is the top curve of Fig. ^ 
the four larger ^ are in the chaotic region A > 0, the four smaller fj, in the periodic one A < 0. 

IV. CONCLUSIONS 



In summary, numerical evidence corroborates and extends Tsallis' conjecture that also 
weak chaotic systems can be described by an appropriate statistical formalism. Such ex- 



tended formalisms should verify precise requirements (concavity, Lesche stability 
and finite-entropy production per unit time) to both correctly describe chaotic systems and 
provide a coherent statistical framework: the last criterion restricts the entropic forms to 
the ones with the correct asymptotic behavior. Using a specific two-parameter class that 
meets all these requirements, the logistic map shows: 

(i) a power- low sensitivity to initial condition with a specific exponent ^ ~ t^/", where 
a = 0.650 ±0.005; this sensitivity can be described by deformed exponentials with the same 
asymptotic behavior ^(t) = exp(At) (see Fig. [T]for examples); 
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FIG. 4: Tsallis' entropy as function of time for the same nine values of /i of Fig. |3J averaged over 
10^ experiments, each one with an ensemble of 10^ points over a grid of 10^ boxes. 

(ii) a constant asymptotic entropy production rate (see Fig. 12)) for trace-form entropies 
with a specific power-behavior p^~°' in the hmit of small probabilities only when the exponent 
a is the same appearing in the sensitivity; 

(iii) a generalized Pesin-like identity holds Sp/t Kp = for each choice of entropy 
and corresponding exponential in the class; the value of Kp = \p depends on the specific 
entropy and it is not characteristic of the map. 

We remark that the physical criterion of requiring that the entropy production rate reach 
a finite and non-zero asymptotic value has to consequences: (1) it selects a specific value 
of the parameter a [a is characteristic of the system); (2) strongly restricts the kind of 
acceptable entropies to the ones that have asymptotic power-law behavior (for instance it 
excludes Renyi entropy The reason we ask for a finite non-zero slope is that otherwise 

we would miss an important characteristic of the system: its asymptotic exponent. 

Finally we have estimated the range of /i for which the sensitivity to initial conditions and 
the entropy are well described by a power law behavior. The answer is clearly dependent on 
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the maximum time considered and on our experimental resolution. For time smaller than 
30 (80) the range appears of the order of 0.07 % (0.03%) 
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